Distributed ARTMAP
نویسندگان
چکیده
Distributed coding at the hidden layer of a multi–layer perceptron (MLP) endows the network with memory compression and noise tolerance capabilities. However, an MLP typically requires slow off–line learning to avoid catastrophic forgetting in an open input environment. An adaptive resonance theory (ART) model is designed to guarantee stable memories even with fast on–line learning. However, ART stability typically requires winner–take–all coding, which may cause category proliferation in a noisy input environment. Distributed ARTMAP (dARTMAP) seeks to combine the computational advantages of MLP and ART systems in a real–time neural network for supervised learning. This system incorporates elements of the unsupervised dART model as well as new features, including a content– addressable memory (CAM) rule. Simulations show that dARTMAP retains fuzzy ARTMAP accuracy while significantly improving memory compression. The model’s computational learning rules correspond to paradoxical cortical data. Distributed Coding By Adaptive Resonance
منابع مشابه
Study of distributed learning as a solution to category proliferation in Fuzzy ARTMAP based neural systems
An evaluation of distributed learning as a means to attenuate the category proliferation problem in Fuzzy ARTMAP based neural systems is carried out, from both qualitative and quantitative points of view. The study involves two original winner-take-all (WTA) architectures, Fuzzy ARTMAP and FasArt, and their distributed versions, dARTMAP and dFasArt. A qualitative analysis of the distributed lea...
متن کاملComparison of ARTMAP Neural Networks for Classification for Face Recognition from Video
In video-based of face recognition applications, the What-and-Where Fusion Neural Network (WWFNN) has been shown to reduce the generalization error by accumulating a classifier’s predictions over time, according to each individual in the environment. In this paper, three ARTMAP variants – fuzzy ARTMAP, ART-EMAP (Stage 1) and ARTMAP-IC – are compared for the classification of faces detected in t...
متن کاملDefault ARTMAP 2 - Technical Report
Default ARTMAP combines winner-take-all category node activation during training, distributed activation during testing, and a set of default parameter values that define a ready-to-use, general-purpose neural network system for supervised learning and recognition. Winner-take-all ARTMAP learning is designed so that each input would make a correct prediction if re-presented immediately after it...
متن کاملComparison of ARTMAP Neural Networks for Classification for Face Recognition
In applications of face recognition from video, the What-and-Where fusion neural network has been shown to reduce the generalization error by effectively accumulating a classifier’s predictions over time, according to each individual in the environment. In this paper, fuzzy ARTMAP and ARTMAP-IC are compared for the classification of faces detected in video frames within the What-and-Where fusio...
متن کاملDistributed ARTMAP: a neural network for fast distributed supervised learning
Distributed coding at the hidden layer of a multi-layer perceptron (MLP) endows the network with memory compression and noise tolerance capabilities. However, an MLP typically requires slow off-line learning to avoid catastrophic forgetting in an open input environment. An adaptive resonance theory (ART) model is designed to guarantee stable memories even with fast on-line learning. However, AR...
متن کاملARTMAP-IC and medical diagnosis: Instance counting and inconsistent cases
For complex database prediction problems such as medical diagnosis, the ARTMAP-IC neural network adds distributed prediction and category instance counting to the basic fuzzy ARTMAP system. For the ARTMAP match tracking algorithm, which controls search following a predictive error, a new version facilitates prediction with sparse or inconsistent data. Compared to the original match tracking alg...
متن کامل